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ABSTRACT 

The growing level of radio frequency interference (RFI) is a recognized problem for research 
in radio astronomy. This paper describes an intuitive but powerful RFI cancellation technique 
that is suitable for radio spectroscopy where time-averages are recorded. An RFI "reference 
signal," is constructed from the cross power spectrum of the signals from the two polarizations 
of a reference horn pointed at the source of the RFI signal. The RFI signal paths obey simple 
phase and amplitude closure relations, which allows computation of the RFI contamination in 
the astronomical data and the corrections to be applied to the astronomical spectra. 

Since the method is immune to the effects of multipath scattering in both the astronomy and 
reference signal channels, "clean copies" of the RFI signal are not required. 

The method could be generalized (1) to interferometer arrays, (2) to correct for scattered solar 
radiation that causes spectral "standing waves" in single-dish spectroscopy, and (3) to pulsar 
survey and timing applications where a digital correlator plays an important role in broadband 
pulse dedispersion. 

Future large radio telescopes, such as the proposed LOFAR and SKA arrays, will require a 
high degree of RFI suppression and could implement the technique proposed here with the benefit 
of faster electronics, greater digital precision and higher data rates. 

Subject headings: instrumentation: detectors — Methods: analytical, interference suppression 



1. Introduction 

The growing level of radio frequency interfer- 
ence (RFI) is a recognized problem for research 
in radio astronomy. Fortunately, the technologi- 
cal advances that are giving rise to the increas- 
ing background of radiation - through increased 
telecommunications and wide-spread use of high 
speed electronics - are also providing some of the 
tools necessary for separating astronomical sig- 
nals from undesirable RFI contamination. New 
radio telescopes will necessarily have RFI suppres- 



sion, excision and cancellation algorithms intrin- 
sic to their designs. No one technical solution will 
make radio observations immune to interference; 
successful mitigation is most likely to be a hier- 
archical or progressive approach throughout the 
telescope, combining new instrumentation and al- 
gorithms for signal conditioning and processing 
(Ekers & Bell 2000; Ellingson 1999). 

Techniques from the communication industry 
that are finding application in radio astronomy 
experiments include (1) adaptive beam form- 
ing with array telescopes that steer nulls of 



1 



the instrument reception pattern in the direc- 
tions of sources of RFI (Hampson ct al. 1998; 
Ellingson & Hampson 2000; Leshem ct al. 2000; 
Smolders & Hampson 2000; Kewley et al. 2000), 
(2) parametric signal modeling techniques, where 
the RFI signal is received and decoded to ob- 
tain a high signal-to-noise ratio (SNR) reference 
signal for subtraction from the astronomical data 
(Ellingson ct al. 2000; Leshem & van der Veen 1999a; 
Leshem & van der Veen 1999b), and (3) adap- 
tive filtering using a reference horn to obtain a 
high SNR copy of the RFI for real-time can- 
cellation from the signal path ahead of the 
standard radio astronomical backend processors 
(Barnbaum & Bradley 1998). 

This paper describes an intuitive but power- 
ful RFI cancellation technique that is suitable 
for radio spectroscopy where time-averages are 
recorded. The method requires computation of 
cross power spectra between the RFI contam- 
inated astronomical signals and high signal-to- 
noise ratio RFI "reference signals" obtained from 
a receiving system that senses the RFI but not 
the astronomical signal. The correction term that 
removes the unwanted RFI is computed from clo- 
sure relations obeyed by the RFI signal. The test 
applications reported here derived the reference 
signal either from a separate horn antenna aimed 
at the RFI source or from a second feed horn at 
the focus of the Parkes telescope, as illustrated in 
Fig 1. For these experiments, we recorded digitally 
sampled baseband signals from two polarizations 
for both the reference and astronomy feeds, and 
then we performed the cross correlations in soft- 
ware off-line. However, the method could use cor- 
relation spectrometers of the sort already in use at 
radio observatories. With minor design enhance- 
ments, future generation correlators could incor- 
porate this technique with the additional benefit 
of the faster electronics, greater digital precision, 
and higher data rates that technological advance 
promises. 

There are a number of advantages to perform- 
ing the RFI in a "post-correlation" stage. Fore- 
most is that the RFI subtraction remains an op- 
tion in the data reduction path, rather than a com- 
mitment made online and permanently. Further- 
more, the correlation method is effectively a co- 
herent subtraction, since the correlation functions 
retain the information describing relative phase 




Fig. 1. — Three configurations applicable to the 
analysis in this paper. Top The four basebands 
are recorded from the 2 polarizations of the Parkes 
telescope feed and 2 polarizations of a reference 
horn directed at the RFI source. Center The 
four basebands correspond to 2 polarizations from 
each of two Parkes feeds. Bottom A proposed sys- 
tem for optimal application of the RFI subtraction 
technique described here. 
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between the RFI entering in the astronomy data 
stream and the RFI entering the reference an- 
tenna. As we show in this paper, this means that 
the RFI noise power is largely subtracted, leaving 
only the usual components of system noise. 

This paper provides a description of the post- 
correlation RFI cancellation technique and illus- 
trates its success with data from the Parkes tele- 
scope. A mathematical overview shows (1) why 
unknown multipaths do not cause the algorithm to 
break down, (2) how to simply construct a suitable 
RFI reference spectrum, and (3) how to build an 
inverse filter to obtain immunity to low signal lev- 
els at frequencies that suffer destructive interfer- 
ence by multipathing in the reference horn signal 
path. 

2. Mathematical description of the method 

In our mathematical model, we make the as- 
sumption that the RFI source emits a single signal 
i(t). (At the RFI source, the signal from a sin- 
gle power amplifier feeds an antenna of unknown, 
but irrelevant, polarization.) The RFI that ap- 
pears differently in the recorded data channels at 
Parkes has experienced scatterings with different 
path lengths and amplitudes, so that the received 
signals are linear sums of time delayed versions of 
the original broadcast i(t). 

In fact, the model is applicable to multiple in- 
terferes within the spectrometer band, provided 
they do not overlap in frequency. 

Consider for the moment a single intcrfcrcr, 
which propagates through the four signal paths si, 
S2, S3, and S4 that will be processed: there are two 
astronomical channels, si(t) and S2(t), which con- 
vey the voltages 04(f) and 05(f) from the celestial 
sources for the two independent polarizations from 
the Parkes Telescope receiver along with contam- 
ination from the RFI signal i(t). Radiation from 
astronomical sources may be partially polarized, 
causing 0.4(f) and 0,3 (t) to be correlated to some 
degree. The two reference channels carry s 3 (f) and 
Si(t), containing the representations of i(t) but 
negligible signal from the celestial sources. For ex- 
ample, the measured signal in channel 1 comprises 
channel noise ni(f), plus the convolutions of the 
impulse responses for the multiple scattering paths 
for the interference signal and the true astronomy 
signal: Si(f) = H A {t)+a A {t) + H 1 {t)+i{t) + n 1 {t). 



Here H A (t) and -ffi(t) are impulse responses for 
the astronomy signal path and interference respec- 
tively, and is the convolution operator. 

For many purposes, an intuitive picture of the 
multipathing results from considering the scatter- 
ing sites to be achromatic mirror-like scatterers 
each with relative effective areas G A j and Gi,fc, 
and attaching the path delay to each separate ver- 
sion of the astronomy and RFI signals, si(f) = 
Y,j G A ,ja A (t - tij) + J2k G i,ki{t - ri,fe) + ni(f). 
The time delays r are determined by the different 
path lengths L\j to give nj = L\j/c, where c is 
the speed of light. 

All the signal paths arc vulnerable to corrup- 
tion by stochastic noise. The noise terms ni(f), 
"-2(f), ns(t), and 714(f) should ideally be uncor- 
rected among the different data paths. Unfortu- 
nately, in real astronomical systems, there is likely 
to be low level coupling between the two orthogo- 
nal polarizations of a feed horn or common stray 
radiation pickup from spillover that will make a 
weakly correlated noise floor in some of the cross 
power spectra. This will form a systematic limi- 
tation to the accuracy of the subtraction. 

In this experiment, the goal is to explore the 
usefulness of cross-correlation spectra to correct 
for the effects of RFI in time-averaged spectra. 
These spectra are products of scaled sums of the 
of the Fourier transforms of the astronomy signals, 
the RFI and noise. In the tests with real data in 
section 4, we compute estimates of the complex 
spectra 

Si(/) = g A A A + g 1 I + N 1 
S 2 (f) = g B A B +g 2 I + N 2 
S 3 (f) = g 3 i + N 3 

S4.f) = 04/ + A4 (l) 

from Fourier transforms of finite length time se- 
ries of discrete samples of the four signals. The 
transforms contain contributions from the celes- 
tial sources A A (f) and As(f), the RFI /(/), and 
the noise in each channel Ni(f), modulated by the 
associated complex voltage gains, which are the 
Fourier transforms of the impulse responses H{t). 
The gains for each channel separate into depen- 
dencies on (1) the path delay L/c, which appears 
in a frequency dependent phase term, according to 
the Shift Theorem of Fourier transforms, and (2) 
a possible additional frequency dependence g(f) 
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of each delay path: 



/c 



(2) 



These complex gain and delay factors are suffi- 
ciently general to include complicated scatterers 
and propagation through dispersive and lossy me- 
dia. 

The real power spectra for the four data chan- 
nels have the following form, once terms that aver- 
age toward zero are omitted and the complex gains 
are assumed to be constant over the time span for 
which the spectra are computed: 



Pl(f) = <SlSJ> 



W) 

Ps(f) 



= M 2 <L4 A | 2 > 
+ l.9i| 2 <l^| 2 > 

= < s 2 s; > 

= \g B \ 2 <\A B \ 2 > 

+ | ff2 | 2 <|/| 2 > + <|7V 2 | 

= < s 3 s; > 

= |. 93 | 2 < \i\ 2 > + < \n 3 \ 2 > 

= < S4SI > 

= M 2 < \I\ 2 > + < \N 4 \ 2 > (3) 



< liVil 2 > 



> 



We use the superscript symbol * to represent com- 
plex conjugation and the < ... > notation to 
signify averages over an integration time tint', in 
the tests we describe in section 4, we find the 
method is effective for tint as long as ~1 sec. 
We adopt a normalization where the power lev- 
els < \A A \ 2 >«< \I\ 2 >«< |iVi| 2 > so that, for 
example, in data channel 1 the signal to noise ra- 
tio SNRi ~ \gA\ 2 , and the interference to noise 
ratio I NR.! ~ |gi| 2 . 

The goal of the RFI cancellation will be to form 
estimates of the |gi| 2 < \I\ 2 > and \g 2 \ 2 < \I\ 2 > 
terms and then subtract them from P\{,f) and 
^M/), while leaving the astronomical signal (and 
noise) behind. 

This discussion has assumed that the complex 
gain terms are constant over the integration time 
tint , allowing us to separate the interference from 
the gain in expressions such as: 



<g 1 Ig* 1 I* >= |si| 2 < \I\ 2 > 



(4) 



In anticipation of the discussion of section 4, we 
note that this assumption will fail for extended in- 
tegration times since the scattering paths that lead 



the RFI signal to the telescope feed will change, 
resulting in loss of precision in the cancellation 
scheme and and leading to substantial residuals in 
the corrected spectra. 

The complex cross power spectra for all com- 
binations of the four data channels have the fol- 
lowing form when the leading contributions are 
retained: 



CM 



CM = 



< Sxs; > 

g A g* B < A A A* B > 
+ 9i9*2 < \I\ 2 > 

+ gi < in; > + g ; < jvi/* > 

+ < JViJV| > 

< SiS* > 

g l g* < \i\ 2 > 

+ g,< IN* > +g* < Nil* > 



+ < NiN* > 
fori 96 j, j >2 



(5) 



In order to cancel the dominant RFI terms in 
the power spectra Eqns 3, we need to compute 
quantities of the form |gi| 2 < \I\ 2 >, which can 
be subtracted from the measured < |Si| 2 >. One 
possibility would be a combination of auto and 
cross power spectra of the form 



M 2 <m 2 > = 



gi9 3 9i93 
9 3 9z 
|C 13 | 2 

< |S 3 | 2 > 



< \IV > 



IC1 



(6) 



M 2 < |/| 2 > + < |iv 3 | 2 > 

However, the problem encountered with this ap- 
proach is that < I S3 1 2 > is biased by the term 
< |iV 3 | 2 >, which averages over time to the to- 
tal power spectrum of the noise in data channel 
3. This might be compensated by calibrating the 
noise spectrum, in order to improve the estimate 
of |<7 3 | 2 < \I\ 2 >=< \S 3 \ 2 > - < \N 3 \ 2 > to use in 
the denominator of Eqn 7. 

An alternate combination that avoids this bias 
forms the estimate of \gi\ 2 < \I\ 2 > from three 
cross power spectra, in which the noise terms have 
the form < NiN* > and < IN* > which average 
toward zero as the integration time increases: 



l.9i| 2 < 



I 2 > = 



9W 3 9i94: 
9 3 94 



< U\ 2 > 
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\92? < \I\ 2 > 



919*2 < \lf > 



C13CU 

92939294 < | 7 |2 > 

3354 
C23C24 

91919293 < | 7 ,2 > 

3331 

C14C23 
C34 



(7) 



(8) 



(9) 



The expressions involving the measured cross 
power spectra are "approximate," since the cross 
power spectra result from finite integrations, and 
the noise terms will limit the precision of the can- 
cellation. 

The occurrence of the C34 term in the denomi- 
nator for Eqns 7-9 indicates there will be a prob- 
lem in implementing a correction scheme in fre- 
quency ranges where C34 becomes small or zero. 
In many situations when the signal to noise ratio 
for the spectra in the numerator is very high, the 
cross power spectra in the numerator will also be 
small or zero whenever C34 is small, so that diver- 
gence will be canceled. A simple means to avoid 
division by small numbers in the presence of noise 
in this kind of situation is to create a filter of the 
following form: 



Iflil 2 < l^l 2 > 
l52| 2 < \I\ 2 > 
919*2 < \I\ 2 > 



Ci 3 C14C34 

V>(/) + C34CS4 

23 ( - / 24 ( - y 34 

V>(/) + c 34 c 3 * 4 

P14P23°34 

+ c 34 c* 34 



(10) 

(ii) 

(12) 



where i>(f) is the square of the power spectrum of 
the noise present in 034(f). Whenever ip(f) be- 
comes small compared to C34(/), the expressions 
Eqns 10-12 revert to Eqns 7-9. When the noise ex- 
ceeds the signal power in C34, the computed cor- 
rection tends to zero. In practice, during the test 
described here, a constant -00 was use d in place 
of tp(f)- Alternatively, division by zero can be 
avoided by testing the amplitude of 634(7) for sig- 
nificance above a noise threshold and setting the 
correction to zero when the significance criterion 
is not met. 

These corrections for the the auto correlation 
spectra (Eqns 7 and 8) are expected to be real 



valued. Therefore a logical test for the accuracy 
of the correction is that phases computed for the 
frequencies of strong RFI signal should be close to 
zero. In fact, this is a statement of phase clo- 
sure. Note that the denominators of Eqns 10- 
12 are purely real, and the numerators, such as 
C l i3C , i4C'34 J form logical triangles for computing- 
closure phases. 

An amplitude closure relation 



C13C24 _ 31533254 



C23C14 



1 



929l9i9l 



(13) 



can also be constructed and tested. It too will 
suffer from divergence of the quotient in frequency 
ranges where the cross power spectra are noisy and 
C23 and C14 have small amplitude. Here we avoid 
including C12, which typically has significant cross 
correlated power in addition to the RFI signal, 
due either to polarized celestial flux or cross talk 
between the channels. 
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3. Noise and the Accuracy of the Cancellation 



In this section we assess the importance of the Interference-to-Noise ratio. First we expand the autocor- 
relation spectra, keeping all cross terms, including those that average toward zero. Then Pi(f) becomes 

Pi(f) = \9a\ 2 < \A A \ 2 > + \ 9l \ 2 < \I\ 2 > + 2Rc [g l9 * A < I A* > + 9l < IN* >] 

+ 2Rc [g A < AN* >} + < \N,\ 2 > (14) 

The complex correction spectra were described by equations 7, 8 and 9. Including the cross terms and noting 
that when 

53 and g 4 > gi and g 2 (15) 
and the interference power to noise power ratios 

INRa - < m 2 > — lff3 ' 

INR, = lg4 J 2 ,fJ,f/ - M 2 » 1 (16) 

then the correction CX\ for Pi(f) becomes: 

C13C14 



CX X 



si* 

°34 
|2 , I r|2 



« Iffil 2 < |/| 2 > + 2Rc [ 9l g* A <IA*> + 9l < IN* >] 

+ s ae1 <A n;> + ^< A*Ni > 

93 9l 

* I 1 2 

+ % < mm > + ^ < N*N 4 > - %J- < N0N4 > (17) 

.93 34 3334 

The terms in Eqn 17 involving / all appear in the power spectrum of Eqn 14, so that application of this 
correction CX\ to Pi (/) leads to a result with no residual contamination by the RFI: 

f>i(/) - CX 1 = \g A \ 2 < \A A \ 2 > + < \m\ 2 > 

+ 2Rc [g A < AN* >} - 9 -^§- < AN* > - %i < A*N 4 > 

93 34 

- % < mm > - Q < mm > + ^r- < > (is) 

93 34 3334 

The complete cancellation of the RFI terms is consistent with the concept that post correlation subtraction 
is equivalent to coherent subtraction of the RFI electric field i(t) in the time domain, which should leave no 
trace of the RFI signal nor an increase in noise power. Provided the INR for the reference horn channels is 
substantially greater than the INR for the Parkes feed channels, the noise terms due to -/V3 and N4 will be 
smaller by a factor of order (3 ~ \JlNR3/INR\ w |33|/|<?i| than the normal noise contributions arising from 
N\ plus the astronomical signal power. The terms in Eqn 18 other than \g A \ 2 < \A A \ 2 > and < |7Vi | 2 >, 
such as {g* A gi/gl) < A*m >oc \g A \(3~H~ 1 / 2 and (34/33) < NiN£ >oc /3 -1 t~ 1/2 , average toward zero (in 
inverse proportion to the square root of the integration time), provided the noise in the signal channels is 
independent. The next higher order terms, which arc not included in Eqn 18, have dependencies such as 
< IN* >< N*m > 1 94 < \I\ 2 >oc t- 1 and g\ < IN£ ><I *m> /g* < \I\ 2 >oc which converge 

toward zero faster than the dominant noise terms. 
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Fig. 2. — Scan averaged RFI spectra measured 
with the reference horn for scan SRT00502. Solid 
line is the cross power spectrum 034(f) defined in 
Eqn 5. Dashed and dotted lines indicate the auto- 
correlation spectra Ps(f) and P±(f) in Eqn 3. The 
spectra have been passband calibrated using ap- 
proximate gain curves for the 5 MHz filters. There 
are 512 frequency channels covering a 5 MHz band. 

4. The test data 

The astronomical dataset used in testing these 
algorithms is a dual linear polarization data 
stream from the CSIRO ATNF 64m telescope at 
Parkes in Australia. One configuration has two 
polarizations from the central beam of the the 
Parkes multibeam receiver (Staveley-Smith et al. 1996) 
and two polarizations from a reference horn aimed 
at an interfering source (Bell et al. 2000). A sec- 
ond configuration uses both polarizations from two 
beams of the Parkes Multibeam system, which are 
directed at slightly different areas of the sky. The 
center frequency of the datasets was 1499 MHz in 
each case. 

The datasets we used are labeled SRT00501, 
SRT00502 and SRT00601 (Bell et al. 2000). The 
main interfering source is a NSW Government dig- 
ital point-to-point microwave link. Examples of 
the time-averaged spectrum for the RFI signal are 
shown in Fig 2. Further details are available in the 
ACA databases (Australian_Communications_Authority 



Sarkissian 1999). The 4 signals were downcon- 
vcrtcd to base band and passed through 5 MHz 
low pass filters. Each signal was then digitized 
with 2-bit precision at a 20MHz sampling rate to 
achieve a factor 2 oversampling and recorded using 
the CPSR recorder (van Straten et al. 2000). 

The data processing for these tests simulates 
a radio astronomy backend by computing power 
spectra and cross power spectra in software. The 
sampled voltages are treated in 8192 sample blocks 
(410^sec durations). Fourier transformation of 
each block yields a spectrum of 4096 independent 
complex coefficients. 

Examples of 25 second averages of the power 
spectra are shown in Fig 3. The RFI spectrum 
is significantly different in the spectra for all four 
data channels. Since the data are 2x oversam- 
pled, we kept the total power and cross power 
spectra of the lower 2048 complex Fourier coeffi- 
cients. The RFI subtraction steps were performed 
on these spectra, as illustrated below, and subse- 
quently the spectra were block averaged by 4 to 
keep power spectra of length 512 spectral chan- 
nels for further calibration and display at 9.8 kHz 
resolution. 

Examples of the cross power spectra are shown 
in Fig 4. Both C12 and C34 have broadband cor- 
related power, which is clear in the integrated 
spectra both as a significant non-zero amplitude 
and as a well defined trend in phase across the 
band. The phase gradients that are clearly visible 
in the C 13 (f), C 14 (f), C 23 (f), and C 24 (f) spectra 
indicate differential path delays. The delay for 
C13C/O1 Ci4(/) and for the channel numbers above 
300 in 023(f), an d C 2 4(f) amounts to 15 time 
steps (0.75^sec). The steeper phase gradient for 
channels below 300 in C 2 3(f), and C 2 4(f) imply 
path delays of 60 time steps — 3/isec or a path 
length of ~900m. Apparently, the frequency de- 
pendent reception pattern of the far sidelobes of 
the Parkes dish, coupled with complicated scatter- 
ers in the field, can lead to quite complex spectral 
dependence for the RFI. A strength of our method 
is the simplicity with which it handles this com- 
plex multipathing. 

Examples of the complex correction spectra de- 
fined in Eqns 7-9 are shown in Fig 5. The spec- 
tra for Correction A and Correction B have zero 
phase over the spectral range where the signal is 
19i}§nificantly non-zero, confirming that phase clo- 




Fig. 3.— The Power Spectra PKS A= Pi(/), 
PKS B= Ref 1= P 3 (f), and Ref 2= P 4 (/) 

for scan SRT00502. These spectra are the averages 
of ^25 seconds of data. A passband calibration 
has been applied to compensate for the gain de- 
pendence of the 5 MHz band limiting filters. The 
upper panels show the spectra both before and af- 
ter cancellation. 



Cross Power Spectra 




200 400 

Frequency [channels] 

Fig. 4. — The Cross Power Spectra 

CMC 13 (f),C u (f),C 23 (f),C 2i (f), and 
C 34 (/) for scan SRT00502. These spectra are the 
averages of ~25 seconds of data. The spectrum 
C34(/) at lower right is also plotted with a 
rescaling of a factor of 100 in order to display the 
noise level away from the frequencies containing 
strong RFI. 
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Fig. 5. — The Complex Correction Spectra de- 
rived from Eqns 10-12 for scan SRT00502 for ap- 
plication to the Parkes spectra A, B, and AxB. 
These plots show the averages of ~25 seconds of 
data. The RFI subtraction was actually performed 
on 82 msec averages. A & B indicate the 2 polar- 
izations. 

Fig 6 shows averages of the amplitude closure 
quantity from Eqn 13, plotted as amplitude and 
phase across the spectrum. There is deterioration 
in the closure relation when the RFI signal is low, 
as expected. 

Fig 2 compares three time-averaged power spec- 
tra representing the RFI signal sensed by the ref- 
erence horn: power spectra for each of the two po- 
larizations and one cross power spectrum. For use 
in correction schemes, the cross power spectrum 
Czi(f) has the advantage that it is not contam- 
inated by the positive bias of the receiver noise 
total power that is seen in the autocorrelation 
power spectra. In practice, the low level corre- 
lated signal in C^{f), due to actual cross corre- 
lated broadband power or due to correlated quan- 
tization noise, may limit the accuracy of the cross 
power spectrum as an estimate of the RFI. 

Fig 7 compares uncorrected and corrected spec- 
tra for two scans. For the purposes of display, 
the spectra have been crudely passband calibrated 
by dividing the spectra by gain templates formed 
from the scan average of the total power spectra 
of scan SRT00601, which was recorded while the 
sky frequency for the Parkes data channels was 
tuned off the RFI frequency. Since this gain tem- 
plate is in common to the processing for both scans 
SRT00501 and SRT00502, some of the common 
structure in the spectra in Fig 7 results from this 
common gain template. 
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Fig. 6. — The complex closure quantity 
C13C24/C23C14 averaged for scan SRT00502. Left: 
full spectrum. Right: expanded scales. Reduced 
scale plots of the average RFI cross power spec- 
trum from Fig 2 are drawn in the bottom panels 
for comparison. 

The time dependence of the RFI sensed by the 
Parkes telescope is displayed in image format in 
Fig 8, side by side with the spectra after the RFI 
subtraction. These spectra received the same pro- 
cessing as described for the averages in Fig 7, with 
the additional step of subtracting a third order 
polynomial spectral baseline from each time step. 
This additional step was done to remove some 
faint variations in the total power level that oc- 
curred from one integration to the next. 

The cross polarized spectrum from the Parkes 
AxB is shown in Fig 9. The figure includes the 
raw spectrum and the corrected spectrum after 
subtraction of the correction shown in Fig 5. Re- 
maining in the corrected spectrum, there is a slow 
modulation of the power across the 5 MHz band, 
probably indicating that this power represents 
broad band noise signal that is scattered within 
the Parkes telescope structure with the same delay 
path lengths associated with traditional standing 
waves and path lengths of a few hundred feet. 

The integration time over which the RFI cor- 
rections are applied is a critical parameter when 
the signal to noise ratio of the reference signal data 
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Fig. 7. — Comparison of two scans: SRT00501 
and SRT00502. Upper Panels: Uncorrected power 
spectra for the two Parkes polarizations. Spec- 
tra for SRT00501 are displaced vertically by 0.2 in 
amplitude. Lower Panels: Corrected power spec- 
tra for the two Parkes polarizations. Spectra for 
SRT00501 are displaced vertically by 0.05 in am- 
plitude. Reduced scale copies of the RFI cross 
power spectrum are included for reference with 
vertical dashed lines to indicate the minima in the 
RFI spectrum. 



Fig. 8. — Dynamic Power Spectra over 564 time 
steps of 82 msec each (Scans SRT00501 and 
SRT00502). There are four spectra plotted in 
parallel with time increasing vertically. Left The 
two Parkes polarizations prior to RFI subtraction. 
Right The two Parkes polarizations after RFI sub- 
traction. All spectra are passband calibrated to 
compensate for the frequency dependence of the 
5 MHz filters. A third order polynomial spectral 
baseline was fitted to channels 30-235, 370-405 and 
420-500 and subtracted for each time step. 




Frequency 

Fig. 9. — Raw and Corrected Parkes AxB cross 
power spectra. Left: The raw, complex cross 
power spectrum. Right: The corrected complex 
spectrum. 



Polarization A Polarization B 




Frequency [channels] 

Fig. 10. — The effect of varying the time inter- 
val on which algorithm described in Eqns 10-12 is 
applied. The interval varies from 8 msec to 8 sec 
in factors of 10. In each panel, the upper spec- 
trum shows the corrected, calibrated, baselined 
spectrum; the lower spectrum is the RMS scat- 
ter about the mean spectrum for each channel as 
a function of time. The typical value for RMS 
should decrease by -\/l0 for each increase in factor 
10 in integration time. 
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path is low. If the integration time is too short, 
then some of the derived correction will be noise, 
and this will be folded into the resulting spectrum. 
On the other hand, if the integration time is long, 
the impulse response functions that couple the as- 
tronomy and RFI signals to the receiver will vary, 
and the mathematics in Eqn 4 and Eqns 7-9 will 
break down. Fig 10 shows a series of tests with 
a range of integration times (t int ~ 8 msec to 8 
sec) for application of the RFI subtraction. In all 
cases, the plots give the grand averages of the en- 
tire 25 seconds of the scan after application of the 
algorithm on the shorter data segments. The pa- 
rameter ip has an appropriate value in each case 
to produce a stable noise level and representation 
of spectral features in the frequency range away 
from the RFI contamination. For these data, the 
algorithm was most effective for integration times 
of only a ~ 1 sec or less. When treated on 8 sec 
averages, substantial RFI remains unsubtracted. 

5. Discussion of Limitations 

The wide range of delays for the scattered 
RFI led to problems in our initial experiments, 
which simulated an FX correlator with 2048 sam- 
ple transforms. The RFI illustrated in Fig 4 has 
two strong components that are delayed by 15 and 
60 time steps. A 60 time step delay is ^3% of 
the time block being processed, so that the cross 
correlation is not being performed on fully over- 
lapped data streams. Increasing the window to 
8192 was adequate to reduce the residuals to a 
level that was barely visible above the noise in 
the corrected spectra. An additional but less sig- 
nificant improvement resulted from applying an 
constant delay offset of 35 time steps to the refer- 
ence signal at the input to the "FX correlator" to 
make it closer to the average of the principal delays 
in the Parkes data channels. A traditional time- 
domain lag correlation spectrometer would not en- 
counter this problem, provided a sufficient number 
of lags arc allocated to fully cover the range of de- 
lays experienced by the RFI. 

In these tests at Parkes, there is a possibility 
that some uncancelled signal may be present due 
to a second transmitter operating at these same 
frequencies. The reference horn was pointed at 
the stronger, nearby transmitter, while the second 
transmitter, located at approximately three times 



the distance, can be scattered into the Parkes Tele- 
scope signal paths without being sensed by the 
reference horn. 

The coarse digitization of the RFI reference sig- 
nals will eventually form a limitation to the preci- 
sion of the subtraction. Crude quantization gener- 
ates an artificial noise floor throughout the spec- 
trum, effectively scattering power out of the nar- 
row band RFI. Since both polarizations from the 
reference horn are recorded at relatively high sig- 
nal to noise ratio, the quantization noise is also 
correlated between the two data channels, so that 
there is corruption of the cross power spectrum as 
well as for the autocorrelation spectra. (The im- 
plication is that the term < N3N4 > in Eqn 5 will 
not average to zero with increased integration.) 

6. The Toxicity Test 

A crucial requirement of an RFI subtraction 
algorithm is that it must leave the astronomical 
signal of interest unaltered. To test the current 
method, we added simulated galaxy signals to the 
two Parkes input data streams. Independent gaus- 
sian noise was filtered with a double-horned galaxy 
profile and the instrumental IF filter passbands 
and then injected into the data pipeline just before 
the correlation stage. Fig 11 shows a comparison 
between the RFI corrected spectra both with and 
without the galaxy. To highlight the difference be- 
tween the injected signal and the output after RFI 
subtraction, the bottom panel shows (1) the dif- 
ference between the output with and without the 
added signal and (2) the ratio of this difference 
to the synthetic galaxy profile added to the in- 
put. The RMS deviation of the ratio about unity 
is 0.005 for polarization A and 0.006 for polariza- 
tion B. No systematic deviations are seen across 
the band, other than rises in noise level at the 
edges where the galaxy profile is approaching zero 
at the edge of the profile. The conclusion is that 
this method does no systematic harm to the as- 
tronomical signals. 

7. The Parkes Two Feed Experiment 

The mathematical description (Eqns. 3 to 12) 
can be equally well applied to a case that uses 
a second feed from the Parkes Telescope as the 
"reference horn." Both feeds may receive astro- 
nomical signals, but since the feeds point different 
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directions in the sky, these are independent as- 
tronomical signals, which will not correlate and 
therefore will not be subtracted from each other 
by this algorithm. The two feeds do sense the 
same RFI signal i(t), although through different 
scattering paths. This is sufficient commonality 
that the cross power spectral approach should per- 
mit each feed to serve as the reference antenna for 
the other. Similar experiments have been reported 
(Sault 1997; Kewley et al. 1999). 
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Fig. 11. — Survival of an injected synthetic galaxy 
signal in the astronomy channels through the RFI 
subtraction process. Top: Raw spectra - with and 
without the synthetic galaxy signal. Center. Cor- 
rected spectra - with and without the synthetic 
galaxy. Bottom: Difference between the corrected 
spectra and the ratio between the input synthetic 
spectrum and the difference spectrum. 
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Fig. 12. — The autocorrelation spectra for both 
polarizations of two feeds of the Parkcs Multi- 
beam System before and after rfi subtraction. An 
attempt was made to apply a passband calibra- 
tion using the same passbands determined from 
the scan SRT006_01 for the reference horn exper- 
iment. The data were treated in ^82 msec aver- 
ages, which in turn were integrated over the 20 
second duration of the scan. 

Fig. 12 shows a comparison between the auto- 
correlation spectra measured for the Parkes two 
feed experiment, before and after RFI subtrac- 
tion. There is noticeable difference among the 
four channels in the effectiveness of the RFI sub- 
traction. This probably results from hte bias 
breated by the broadband polarized flux or cor- 
related noise in the cross polarized spectra 3x4 
that is being used as the "reference" for data chan- 
nels 1 and 2. As shown in Fig. 13, this noise 
floor is higher in feed 2 (INR ~ 35:1) than in 
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feed 1 (INR <~ 100:1), causing the rfi template 
spectra derived from the cross power spectra to be 
less faithful, which in turn leads to larger error in 
the correction spectra to be subtracted from feed 
1. For comparison, the reference horn spectrum 
C 34 (/) in Fig 4 has INR ~ 1000:1 
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Fig. 13.-- The cross polarization spectra for two 
feeds of the Parkes Multibeam System before and 
after rfi subtraction for scan SRT00108. An at- 
tempt was made to apply a passband calibra- 
tion using the same passbands determined from 
the scan SRT006_01 for the reference horn exper- 
iment. The data were treated in ^82 msec aver- 
ages, which in turn were integrated over the 20 
second duration of the scan. Dotted lines show 
the spectra amplified by a factor 10. 



8. Conclusions 

RFI subtraction can be performed using cross 
power spectra between the astronomy data chan- 
nels and RFI "reference" channels. In principle, 
the reference channel can also be an astronomy 
channel provide it carries an astronomy signal that 
is uncorrelated with the astronomy in the channel 
that is being corrected. 

The tests made at Parkes demonstrate that a 
specifically designed reference sensor provided a 
higher signal-to-noise ratio reference signal - and 
consequently cleaner cancellation - than that ob- 
tained from a second horn feed at the Parkes Tele- 
scope focus, whose principal function is to illumi- 
nate the Parkes dish. 

A refinement will be to implement this scheme 
using two reference antennas that are spatially 
separated (as in the lower diagram of Fig 1) in or- 
der to avoid correlated noise contributions, while 
still obtaining as clear and stable path to the RFI 
source as possible. The cross power spectra from 
the two spatially separated antennas would form 
an optimal RFI reference spectrum C34 for use in 
the Eqns 10-12. To avoid problems with differen- 
tial delay causing loss of coherence in the reference 
signal, the spectrometer would need to operate 
with spectral resolution A/ = (A0/27r)c/L << 
c/L where A(f> is the allowable phase rotation 
across a spectrometer channel and L is the spatial 
separation of the sensors. The 2.4 kHz spectrom- 
eter resolution emulated in software for the study 
reported here would allow spatial separations of 
up to 1200m, if A(j) is required to be less than 

0. 027T radians. 

There are a number of advantages to perform- 
ing this type of "post-correlation" RFI subtrac- 
tion: 

1. Provided the required correlation products are 
recorded (i.e. the online system is capable of 
recording correlation functions with a sufficiently 
large number of delay lags), the RFI subtraction 
can be performed offline, where it remains an op- 
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tion in the data reduction path, rather than a com- 
mitment made online and permanently. 

2. The method is not vulnerable to the effects 
of sporadic RFI, which hurt many algorithms that 
have an initialization period while they acquire the 
RFI signal and optimize their cancellation param- 
eters. 

3. Nor is the result influenced by changes in beam 
shape during adaptive nulling. 

4. The correlation method is effectively a coherent 
subtraction, since the correlation functions retain 
the information describing relative phase between 
the RFI entering in the astronomy data stream 
and the RFI entering the reference antenna. We 
showed in section 3, this means that the RFI noise 
power is largely subtracted, leaving only system 
noise. 

5. Generalization of the method to an array 
of telescopes is straightforward but demands ad- 
ditional correlator capacity. If there arc two 
reference signal sensors, labeled u x" and "y," 
that sense negligible astronomical signal, then 
their cross power spectrum C xy (f) containing a 
high INR signal can be used to correct any other 
power spectrum Cij(f) through the closure rela- 
tion C ix C* y /C* y . The i, j indices can denote or- 
thogonal or parallel polarizations drawn from any 
combinations of antennas in the array or auto cor- 
relation, when i = j. 

6. A modification of the method can be applied 
to pulsar data streams in which a digital corre- 
lator replaces the narrow band filter bank used 
in compensating for pulse dispersion. One pos- 
sible implementation would construct cross-power 
"coupling spectra" X(f) that are valid for the time 
interval tint during which the "g factors" of Eqn 1 
are stable. The coupling spectrum is 

v , f \ 9i9i ^ Ci4 
A i3l/j = T^r 

3354 L, 3 4 

where C\\ and C34 are averaged for up to 1 second 
as appropriate. Then the correction CX\ can be 
computed and applied to cancel RFI in measure- 
ments of Pi(f) on shorter timcscales: 

CX 1 = | 5l | 2 < \I\ 2 >= X 139l g* < \I\ 2 >« X 13 < S1S3* 

where < Si S3 >= C13. Alternatively one could 
construct the corrected time sequence s\(t) by 



subtracting the correction 

SX 1 = gi I = X* 13 g 3 I w X* 13 S 3 

from Si (/) and inverse Fourier transforming to ob- 
tain an RFI cancelled version of Si(t). Compu- 
tationally efficient schemes could be implemented 
that include coherent dedispersion (Hankins 1974) 
in the same transform operations as the RFI can- 
cellation. 

7. The method can be generalized to removal of 
solar radiation whose multi-path scattering effects 
give rise to the spectral "standing wave" prob- 
lem. The important difference that the Sun gener- 
ates a dual polarized signal with a variable polar- 
ized component; this will necessitate a processing 
path more akin to the sub-space decomposition 
(Ellingson 1999; Leshem et al. 2000), in order to 
identify orthogonal components of the solar "rfi" 
signals. 

8. The present generation of digital correlators, 
which typically operate with single bit to 9 level 
precision, could implement this method for use in 
moderate levels of RFI for testing and astronomi- 
cal observation in the near future. 

The disadvantages of the method arc: (1) The 
data rates will be high, since the method requires 
a full-scale cross correlator, preferably with multi- 
bit precision to accept large SNR RFI reference 
signals, that must dump spectra after relatively 
short integrations of less than ~1 sec. Of course, 
these data rates are lower than recording the full 
baseband, but they are substantially higher than 
a real-time adaptive filter approach, which would 
allow long spectral integrations once the RFI has 
been canceled. (2) When the interference is much 
stronger than the astronomical signal, a 1 or 2 
bit sampler is "captured" so that the data stream 
consists primarily of ±2, and the zero crossings 
are determined by the phase of the interferer. Un- 
der these conditions, the astronomical data will be 
largely lost. These applications will require corre- 
lators with greater digital precision. 

The case where multiple interferers occupy the 
same frequency band will require a greater number 
of sensors and more correlator capacity devoted to 
processing the the RFI signals, as laid out in the 
analyses of Sault (1997) and Ellingson (1999) . 

The authors are grateful to W. van Stratten, 
M. Bailes, S. Anderson, S. Ellingson, R. Sault, P. 
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Perillat, R. Ekcrs, J. Bunton, L. Kewley, M. Smith 
and P. Sackett for helpful comments and discus- 
sion. F.B. is grateful to the ATNF in Epping, 
NSW, the Department of Astronomy at OSU, 
Columbus, OH, and to the IAS, Princeton, NJ for 
their hospitality while this work was done. 
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